Lifting 2D Human Pose to 3D with Domain Adapted 3D Body Concept

نویسندگان

چکیده

Lifting the 2D human pose to 3D is an important yet challenging task. Existing estimation suffers from (1) inherent ambiguity between and data, (2) lack of well-labeled 2D–3D pairs in wild. Human beings are able imagine a image or set body key-points with least ambiguity, which should be attributed prior knowledge that we have acquired our mind. Inspired by this, propose new framework leverages labeled poses learn concept reduce ambiguity. To consensus on pose, key insight treat as two different domains. By adapting domains, learned applied guides encoder generate informative “imagination” embedding lifting. Benefiting domain adaptation perspective, proposed unifies supervised semi-supervised principled framework. Extensive experiments demonstrate approach can achieve state-of-the-art performance standard benchmarks. More importantly, it validated explicitly effectively alleviates improves generalization, enables network leverage abundant unlabeled data.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Neural Networks for 2D to 3D Human Pose Estimation

Neural networks have nowadays been applied to almost every conceivable problem in computer vision. Human pose estimation is another long standing problem which is now being revisited thanks to this novel technique. This work investigates two questions repeatedly asked when applying neural networks: how to obtain enough data to train them, and more fundamentally how to leverage structure of the ...

متن کامل

Generative 2D and 3D Human Pose Estimation with Vote Distributions

We address the problem of 2D and 3D human pose estimation using monocular camera information only. Generative approaches usually consist of two computationally demanding steps. First, different configurations of a complex 3D body model are projected into the image plane. Second, the projected synthetic person images and images of real persons are compared on a feature basis, like silhouettes or...

متن کامل

3D Human Body Pose Estimation by Superquadrics

Abstract: This paper presents a method for 3D Human Body pose estimation by using a multi-camera system. The pose is estimated by RANSAC-object search with a robust least square fitting of 3D points to SuperQuadric (SQ) models of the searched object. The solution is verified by evaluating the matching score between the SQ object model and 3D real data captured by a multi-camera system and segme...

متن کامل

Real-Time 3D Body Pose Tracking from Multiple 2D Images

We present a human body motion tracking system for an interactive virtual simulation training environment. This system captures images using IR illumination and near-IR cameras to overcome limitations of a dimly lit environment. Features, such as silhouettes and medial axis of blobs are extracted from the images which lack much internal texture. We use a combination of a 2D ICP and particle fil...

متن کامل

2D-3D Pose Consistency-based Conditional Random Fields for 3D Human Pose Estimation

This study considers the 3D human pose estimation problem in a single RGB image by proposing a conditional random field (CRF) model over 2D poses, in which the 3D pose is obtained as a byproduct of the inference process. The unary term of the proposed CRF model is defined based on a powerful heat-map regression network, which has been proposed for 2D human pose estimation. This study also prese...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: International Journal of Computer Vision

سال: 2023

ISSN: ['0920-5691', '1573-1405']

DOI: https://doi.org/10.1007/s11263-023-01749-2